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Abstract 


In numerical analysis, the process of fitting a function via given data is 
called interpolation. Interpolation has many applications in engineering 
and science. There are several formal kinds of interpolation, including 
linear interpolation, polynomial interpolation, piecewise constant interpo- 
lation, trigonometric interpolation, and so on. In this article, by using 
Sigmoid functions, a new type of interpolation formula is presented. To il- 
lustrate the efficiency of the proposed new interpolation formulas, some ap- 
plications in quadrature formulas (in both open and closed types), numer- 
ical integration for double integral, and numerical solution of an ordinary 
differential equation are included. The advantage of this new approach is 
shown in the numerical applications section. 
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1 Introduction 


Interpolation is the process of finding a function via given data. Interpolation 
has many applications in engineering and science. There are several formal 
kinds of interpolation, including linear interpolation, polynomial interpola- 
tion, piecewise constant interpolation, trigonometric interpolation, and so 


on. For example, consider the polynomial interpolation. Let fo, fi,..-, fn 
be known values for an arbitrary function f : R > R at points 7 = 4, 
i=0,1,...,n. Then the Lagrange basis functions are defined as 
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Lni(t) = Il ae i=0,1,...,n. (1) 


p(t) = > Enso) fi () 


Clearly, p(a) satisfies p(a;) = f; for 1 = 0,1,...,n. Moreover, for any f € 
C"*11a,b], we have 


Nx € [a, Ob]. 
(3) 


Using relation (2), the classical Newton—Cotes quadrature formulas are ob- 
tained [2, 3, 6, 7, 8, 9]. In this article, by using Sigmoid functions [1, 4, 5], 
new types of interpolation formulas are presented. These new types of in- 
terpolation result in new integration formulas and new formulas for solving 
ordinary differential equations. 


f(e) = 0 Lna(z) fi + (@ — a0)(@ — 21) +++ (a — tn) 
1=0 


Sigmoid functions are mathematical functions with S-shaped curves or 
sigmoid curves. These functions are bounded and monotone and have the first 
derivative that is bell shapes. Additionally, these functions are constrained 
by a pair of horizontal asymptotes as x —> +oo. Some of them are listed 
below. 

a. Logistic function is defined by the formula 


1 


b(x) = i 


b. Hyperbolic tangent function is defined by the formula 


e*~—e * 
= tanh(¢) = ——_—_.. ) 
(a) = tanh(x) = [= (5) 
c. Arctangent function is defined by 
o(x) = arctan(z). (6) 


d. Gudermannian function is defined by 


1 x 


dx = 2 arctan(tanh( 5 )). (7) 


a(a) = gate) = [ 


cosh x 


e. Error function is defined as 
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(2) = erste) =e feta (8) 
x) =erf(x) = — € : 
vi Jo 
f. Generalised logistic function is defined as 
o(2) =(1te*)"*, a >0. (9) 


g. Some algebraic functions, for example, 


o(z) = cae (10) 


h. Smoothstep function is defined for N > 1 as 


siz (a - )Ndu) fo(i—w?)Ndu, elt, ayy 


sgn(x), |x| > 1. 


I. The integral of any continuous, nonnegative, and “bump-shaped” function 
will be sigmoid function; therefore the cumulative distribution functions for 
many common probability distributions are sigmoid functions. 

This article is organized as follows. In section 2, new methods of inter- 
polation are introduced. In section 3, some applications of the proposed new 
interpolation formulas are provided. Finally, in section 4, conclusions are 
presented. 


2 Main results 

In this section, the new types of interpolation formulas for one- and two- 
dimensional cases by using Sigmoid functions are obtained. 

2.1 One-dimensional case 


Theorem 1. Let ¢ be an arbitrary Sigmoid function and let 


lim (x) =a, 
at Oe (12) 
xt—-+co — 
Let fo, fi,---,fn be known values for an arbitrary function at points 29 < 


ty <-++ << @y, and let x41 — 2; = h; fori =0,1,2,...,n. Then 


S() => (;2 2) felOleie— 0) — Alaa bin)} 09) 
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is the interpolation formula for the above data points. Moreover, a; for 


b h; 
4=0,1,2,...,n+1 are positive and big enough numbers, —=%7,- oi for 
ay 
bn+ h; 
é=0/1,9)25,n,.and — : = 
An+1 2 


Proof. According to the properties of the Sigmoid functions, 0 < d(aja — 
b;) — b(ai41x — 6:41) < b—a. Therefore, for positive and big enough aj, ina 


neighborhood of x = —, the function [d(a;x — b;) — b(ai41x — bj41)| changes 


aj 
Ait 
from zero to b—a (for i=0,1,...,n). Similarly, at c = = the function 
i+] 
[p(aix — b;) — O(ai41% — bj41)] changes from b—a to zero (for i = 0,1,...,7). 
bi 5; 
Therefore, for the interior points in intervals E ais | fori = 0,1,...,n, 
Qa, Ai4+1 


b; 
S(x) is equal to f;. In a neighborhood of x = — (for i = 1,2,...,n), 
S(a) is changed from f;-1 to f;. In the same way, in a neighborhood of 


b; 
g= 1 (for i = 0,1,...,2—1), S(a) is transformed from f; to fi41. In 
Aj+1 
b 
addition, in a neighborhood of « = aa S(a) is changed from zero to fo, and 
ao 
in a neighborhood of c = ++, § (x) is changed from f, to zero. Speed 
An+1 
of changing can be increased by increasing a; (for 7 = 0,1,...,2 +1). In 
other words, a; and =, i = 0,1,...,n +1, define the speed and locations 


v 
of the changes. Therefore, S(x) is the interpolation formula for aforesaid 
points. 


2.2 Two-dimensional case 


By using the above idea for two-dimensional problems, a new type of two- 
dimensional interpolation formulas can be obtained. 


Theorem 2. Let F(«;,y;) = %,; for i =0,1,2,...,n and j =0,1,2,...,m. 
Let ¢ and w be two arbitrary Sigmoid functions and let 


iim o(x) =4, lim Y@) = 6 
“Tim 6(e) =. lim v(o) = 4 ve 


Let %o < 41 < ++: < &p and yo < Yt < +++ < Ym (ie, Vig, — 1 = hi, for 
i=0,1,...,n-1, and y;41 — yj; =k; for 7 =0,1,...,m—1). Then 
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se. => (_4,) (=) Zig (15) 


i=0 j=0 


[p(aix — bi) — O(aigie — bi41)] [ajy 7 bj) = blajyay = a) 


is the interpolation formula for the above data points. Moreover, a; for 
a= 0,1,2,...,n +1 and a; for 7 = 0,1,2,...,m-+ 1 are positive and big 
enough numbers. In addition 


bj hj ‘ bn hn 

=a; , t=0,1,2,...,n and eget te 
ay 2 An+1 2 (16) 
b, ky b, ee 
ayes, 9 30,1,2)...5m and ““"=y,4 : 
a; 2 Am+1 2 


Proof. By using relation (13) two times, relation (15) is obtained. 


In the next section, some numerical applications in interpolation, numer- 
ical integration, and numerical solution of ordinary differential equations are 
included. 


3 Numerical applications 


In this section, some applications of formula (13) in one-dimensional interpo- 
lation, numerical integration, and numerical solving of ordinary differential 
equations by using the Hyperbolic tangent function are given. Other formu- 
las (i.e., (4)-(11)) can easily be applied. Also, in Example 6, formula (15) by 
using the Hyperbolic tangent function is applied. 


Example 1 (Interpolation problem). Let f(0) = 1, f(1) = 2, f(2) = 4, 
f(3) =7, f(4) = 5, and f(5) = 6. Then using formula (13), the interpolation 
function is obtained as 


5 
Sta) = (5) S- f(z;) [tanh(ajx — b;) — tanh(a;412 — bj41)] 


i=0 
= (5) (1 x [tanh(apx — bo) — tanh(a1x — b1)| 


+2 x [tanh(a,;x — b;) — tanh(agx — be 


( ( ) 

+4 x [tanh(agz — b2) — tanh(a3x — 63) 
( — tanh(asx — b4) 

) 


— tanh(asx — bs 


NA MEX RES NS 


[ 
[ 

+7 x [tanh(agx — bs 
[ 
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This interpolation function in two cases (i.e., a9 = a1 =--- =ag =5 and 
ap = a, = ++: = ag = 10) is plotted in Figures 1 and 2. 


2 2 4 6 8 


Figure 1: Interpolation function with a; =5 for i=0,1,...,6. 


Figure 2: Interpolation function with a; = 10 for i=0,1,...,6. 


Example 2 (Interpolation problem (Runge’s function)). Consider the poly- 
nomial interpolation of Runge’s function defined as (see [9]) 


1 
142542’ 


g(x) x € [-1, 1]. (18) 

The polynomial interpolating with N = 15 equidistant nodes is plotted in 
Figure 3. Also, using formula (13), the new interpolation is obtained. This 
interpolation function is plotted in Figure 4. The error function of polynomial 
interpolation is plotted in Figure 5. As you can see, the error at nonnodal 
points does not decrease with the increase of nodes; see [3, 9]. Also, the error 
function of the new interpolation is plotted in Figure 6. 


Some applications of Sigmoid functions 227 


a wa 06° 04° 02° 9 02 04 06 Nee) 1 
x 


Figure 3: Polynomial interpolation function of Runge’s function with N = 15 equidis- 
tant nodes in [—1, 1]. 


Figure 4: The new interpolation function of Runge’s function with N = 15 equidistant 
nodes in [—1, 1] and a[i] = 100 for i = 0,1,2,...,15. 


4 wa 06 04 02° 9 0.2 0.4 0.6 NG] 1 
x 


Figure 5: Error function of the polynomial interpolation function for Runge’s function 
with N = 15 equidistant nodes in [—1, 1]. 
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Figure 6: Error function of the new interpolation formula for Runge’s function with 
N = 15 equidistant nodes in [—1,1] and a[i] = 100 for i = 0,1,2,...,15. 


Example 3 (Numerical integration (closed type)). Quadrature formula of 
Newton—Cotes on the finite interval [a, b] is defined as (see [7, 8]) 


é n 
[ fdr = wits) + Ralf). (19) 
o i=0 


b-—a 


where x; are equidistantly distributed with the step size and x; = a+th, 


i =0,1,...,n. In addition, Rp(f) = 0 whenever f € Pn—i, where Py_1 is 
the space of all algebraic polynomials of degree at most n — 1. Now, using 
relation (13) for ¢(a) = tanh(z) results in 


[sou ~ [ seoee 


a ibs (5) f;[tanh(aja — by) — tanh(a;412 — bj41)] dx(20) 
@ i=0 


Therefore, relation (20) is simplified as 


n 


| iain ae (se) [In(cosh(a;b — b;)) — In(cosh(a;a — b4)] (21) 


1=0 


1 
= ( ) (In(cosh(a;41b = bi41)) = In(cosh(a;41a = bi+1)] fi 
2ai41 


As it is mentioned above, explicit forms of quadrature formulas based on this 
new interpolation formula can be directly obtained. As an example, consider 
the following integral: 
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Table 1: Absolute error of quadrature formula (21) for n = 5(5)30 and f(a) = exp(x?). 


n | Absolute error 
5 1.8(-2) 
10 4.5(-3) 
15 2.0(-3) 
20 1.0(-3) 
25 4.0(-4) 
30 1.2(-4) 
1 
| exp(x”)da © 1.46265174590718. (22) 
0 


The absolute error of formula (21) to approximate the above integral, for 
a; = 100, = 0,1,...,n, is presented in Table 1. 
Example 4 (Numerical integration (open type)). In relation (19), if wo = 
Wn = 0, then the open type of Newton—Cotes formula is obtained. In this 


case, R,(f) = 0 whenever f € P,-3. The new quadrature formula in this 
case is as follows: 


| "fades | * S(a)da (23) 
_ ‘| po (5) PAC Cee ee eee 


Therefore, relation (23) is simplified as 


[ f(z)dx = s i() [In(cosh(aib — b;)) — In(cosh(a;a — b;)] 


1 
= ( ) [In(cosh(a;41b = bi41)) = In(cosh(a;+41a = bi+1)] fi 
2ai41 
As an example, consider the following integral: 
i 
| x sin (2) dx = 0.008384044187. (24) 
0 x 


The absolute error of formula (24) to approximate the above integral, for 
a; = 100,72 = 0,1,...,n, is presented in Table 2. 


Example 5 (Numerical methods for solving ordinary differential equation). 
Consider the following ODE: 
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Table 2: Absolute error of quadrature formula (24) for n = 5(5)30 and f(x) = 
100 sin(+). 


n | Absolute error 

5 8.38(-3) 

10 8.38(-3) 

15 8.32(-3) 

20 8.12(-3) 

25 7.79(-3) 

30 7.39(-3) 
dy 
de (25) 
y{0) = 0, 


with exact solution y(x) = exp(x) — x — 1. Integrating both sides of relation 
(25) on interval [0,2] and using initial condition result in 


y(x) = y(0) + [eo +y)ds = 52 + a yds. (26) 


Now, using the new interpolation formula for y results in 


», (5) y(x;) [tanh(a;x — b;) — tanh(aj+12 — bi+1)] (27) 
i=0 
= 52 ~ a 2 (5) y(a;) [tanh(a;s — b;) — tanh(ai418 — baal ds. 


Let Qi (x) = tanh(a;x — b;) — tanh(aj41” — 6:41) for 7 = 0,1,2,...,n. Then 
relation (27) is simplified as 


n 


2s (5) y(ai)Qi (2) = 52 + i ys (5) veda] ds 


i=0 1=0 
a Sy. (5) 2, v0) , Qi(s)ds (28) 


Finally, relation (28) is simplified as 


Yate (ala) - 
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By collocating (29) at x;, i =1,2,...,n, the unknown values of y(2;) are 
a 


obtained. For example, the error function on [0,1] for n = 10, and 2; = To’ 


i= 1,2,...,10, is plotted in Figure 7. Also, the error function on [0,1] for 


n = 20 and x; = a 4=1,2,...,20, is plotted in Figure 8. 


ral 
<I 
eae 
a 
— 


0.04 4 


Figure 7: The error function of Example 5, with n = 10 in [0,1] and afi] = 100 for 
=0, 1,2) 0.510, 


~hcenaanngthll Ml 
penny 


Figure 8: The error function of Example 5, with n = 20 in [0,1] and a[é] = 100 for 
i=0,1,2,...,20. 


Example 6 (Numerical integration for double integral). Now using relation 
(15) results in 
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Table 3: Absolute error of quadrature formula (30) for n = 5(5)30 and F(z,y) = 
exp(a + y?). 


n | Absolute error 
5 5.30(-2) 
10 1.3(-2) 
15 5.83(-3) 
20 2.97(-3) 
25 1.19(-3) 
30 3.46(-4) 


[ [ Peeotdyaes [Pf stesobayae (30) 
“[L£EXG) « 


i=0 i=0 
x [tanh(a;x = b;) = tanh(aj412 = bi+1)] 


x [tanh(a,y = ee tanh(a,,.y - Bes) dady.(31) 


As an example, consider the following integral: 


1 1 
| i exp(2? + y”)dydx & 2.139350130. (32) 
0 0 


The absolute error of formula (30) to approximate the above integral, for 
a; = 100,27 = 0,1,...,, is presented in Table 3. 


4 Conclusions 


In this article, by using Sigmoid functions, the new types of interpolation 
formulas were presented. To show the efficiency of the proposed new inter- 
polation formulas, some applications in quadrature formulas (in both open 
and closed types), numerical integration for double integral, and numerical 
solution of ordinary differential equation were included. Numerical results 
were obtained by using the Hyperbolic tangent function, which can be easily 
changed by other Sigmoid functions. 
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